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Abstract 

When a reciprocating heat engine is started it eventually settles to a stable mode of operation. 
The approach of a first principle quantum heat engine toward this stable limit cycle is studied. 
The engine is based on a working medium consisting of an ensemble of quantum systems composed 
of two coupled spins. A four stroke cycle of operation is studied, with two isochore branches 
where heat is transferred from the hot /cold baths and two adiabats where work is exchanged. The 
dynamics is generated by a completely positive map. It has been shown that the performance of this 
model resembles an engine with intrinsic friction. The quantum conditional entropy is employed 
to prove the monotonic approach to a limit cycle. Other convex measures, such as the quantum 
distance display the same monotonic approach. The equations of motion of the engine are solved 
for the different branches and are combined to a global propagator that relates the state of the 
engine in the beginning of the cycle to the state after one period of operation of the cycle. The 
eigenvalues of the propagator define the rate of relaxation toward the limit cycle. A longitudinal 
and transverse mode of approach to the limit cycle is identified. The entropy balance is used to 
explore the necessary conditions which lead to a stable limit cycle. The phenomena of friction can 
be identified with a zero change in the von Neumann entropy of the working medium. 

PACS numbers: 
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I. INTRODUCTION 



On starting up a reciprocating four stroke engine, after a few cycles, the engine settles 
to a limiting smooth cycle of operation. The present theoretical analysis is devoted to the 
characterization of the transition period from the state when the engine is started up to the 
sequence of states characterizing the periodic steady state termed the limit cycle. The pro- 
cess has similarities to the approach to thermodynamical equilibrium of an initially displaced 
state. This relaxation to equilibrium is accompanied by entropy production signifying the 
irreversible character of the process. Entropy is produced in the approach to the limit cycle 
but unlike an equilibrium state entropy continues to be produced also when the limit cycle 
is reached. 

The approach to a limit cycle is based on the concept of a basin of attraction where the 
limit cycle is located at its minimum. The basin of attraction is set by external and internal 
constraints. Dissipative forces cause the system to settle down to the minimum of such 
a basin. A first principle study requires to determine the equations of motion governing 
the dynamics of the engine. For this task in the study, the framework of open quantum 
systems is employed [ll The key point is that the dynamics of the engine is governed by 
a completely positive map 3]. Then the limit cycle becomes a fixed point of this map. In 
order to determine if the approach to the limit cycle is monotonic, a measure of distance 
between the actual state of the engine and the final limiting cycle has to be defined. Such a 
measure of distance between two quantum states is not obvious due to the possibility that 
the two states do not commute. In analogy to linear response theory it is expected that 
close enough to the limit cycle all distance measures should show the same relaxation rate 
toward the target limit cycle. This prediction is consistent with the results of the present 
study. Nevertheless at large distance from the limit cycle only the quantum measures show 
a monotonic approach to it. 

The present paper is a continuation of a series of studies on a four stroke quantum engine 
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]. The models studied were based on a first principle quantum description of 
the dynamics. The previous studies showed that the model engine displays the irreversible 
characteristics of common real heat engines operating in finite time. The performance of 
the quantum engine was found to be limited by finite heat transfer. In addition quantum 
performance limitations on the adiabatic branches mimicked very closely macroscopic friction 
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phenomena 



17] 



The quantum discrete heat engine is composed of a quantum working fluid, a hot and a 
cold bath and an external field which can alter the energy levels of the working medium. The 
control parameters are the time allocations on the different branches, the total cycle time 
and the extreme values of the external field. All four branches are described by quantum 
equations of motion. The thermodynamical consequences can therefore be derived from 
first principles. A minimum set of three thermodynamical observables was found which 
were sufficient to characterize the performance of the engine. With two additional variables, 
the state of the working fluid could also be characterized jsj]. Knowledge of the state is 
necessary in order to evaluate the entropy and the internal temperature, variables which are 
necessary to establish a thermodynamic perspective. 

The intuitive notion is that the limit cycle is characterized by the external constraints 
and internal properties of the engine. The following questions arise naturally: 

• How do the control parameters characterize the approach to the limit cycle? 

• Can conditions be found for the non-existence of a limit cycle? 

• What are the irreversible properties of the limit cycle? 

The present paper is devoted to the study of these issues in the context of quantum ther- 
modynamics. 

II. QUANTUM THERMODYNAMICAL OBSERVABLES AND THEIR DYNAM- 
ICS 

In the field of quantum thermodynamics, thermodynamical variables are associated with 
quantum mechanical observables. An observable (A), is defined as the following scalar 
product between the operator A and the density operator p: 



The dynamics of the quantum thermodynamical observables are described by completely 
positive maps within the formulation of quantum open systems 

ii a. 

The dynamics is 

generated by the Liouville super operator, which in the Heisenberg picture becomes: 



(A) 




(1) 



where £ is a generator of a completely positive map: T(t) = e . The generator £ can be 
decomposed to the unitary and dissipative contributions C* = C* H + C* D . The second term 
in Eq. (J2J addresses a possible explicit time dependence of the operator. 

The thermodynamical construction follows Gibbs by seeking a minimum set of variables 
associated with the quantum orthogonal observables {B^}. This set should be sufficient to 
completely determine the state of the system p. In addition the set should be closed for 
the dynamics i.e for the operation of C*. Any cycle of a heat engine can be decomposed 
into a sequence of four completely positive maps defining the different branches. Eventually 
this sequence closes upon itself. A thermodynamical description therefore means that the 
set of variables should be closed for the dynamics during all branches of the operation. In 
equilibrium statistical mechanics the energy of a subsystem is sufficient to determine its 
state. In the present non-equilibrium example, additional variables (B^) are required to 
define the state of the working fluid. The set of time dependent expectation values b(t) are 
used to reconstruct the density operator: 

p = > ( 3 ) 

k 

where the expansion coefficients become = (B^), ^B^ ■ B^J = trjB^Bj} = dkj, tr{Bfc} = 
0, and N is the size of the Hilbert space. 



A. Quantum entropy 

Thermodynamic measures require the knowledge of the state of the system p. Entropy, 
the most common measure, is associated with the lack of knowledge or dispersion of the 



system 



D 



10j . The entropy associated with a measurement of an observable (A) with N 



possible outcomes becomes: 



N 



Sa = -^PjtoSPj , ( 4 ) 



where pj = tr{Pjp} and Pj is the j projection operator of the operator A = (XjPj, and 
where the spectral decomposition (A\4>j) = aj\(f)j), Pj = \(t>j){(j>j\) was utilized. Looking 
for the observable which complete measurement maximizes the information on the state, is 
equivalent to minimizing the entropy with respect to all possible observables. This process 
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leads to the von Neumann entropy 

S = -tr{plogp} , (5) 

and the optimum operator that minimizes dispersion commutes with the state p. 

The distance from a reference state p re j- is a key component in the study of the approach 
to the equilibrium or to the steady state. The conditional entropy is associated with the 
lack of information on the state p subject to the knowledge of a reference state p re f- The 
conditional entropy associated with a measurement of a particular observable becomes: 

3 Qj 

where qj = tr{Pjp re A. The conditional entropy is bound from above and positive: 

S A (p) > S A (p\p ref ) . >0 (7) 

The value zero is reached only when p = p re t- 

Maximizing Eq. © with respect to the operator A, leads to an entropy measure which 
depends only on the two states: 

S{p\Pref) = -^{pQogP-^gPre/)} , (8) 

S(p\p re f) = when the two states become indistinguishable. 



B. Conditions for the monotonic approach to the limit cycle 



Lindblad Uj has proven that the conditional entropy decreases if a completely positive 



map is applied to both the state p and the reference state p re f 

S(p\p ref ) > S(Tp\Tp ref ) , (9) 

where T is a completely positive map. An interpretation of Eq. © is that a completely 
positive map reduces the distinguishability between two states. This observation has been 
employed to prove the monotonic approach to equilibrium, provided that the reference state 
p re j is the only invariant of the mapping T i.e. 7" Pref = Pref Il3 1 . 

The same reasoning can prove the monotonic approach to the limit cycle. The mapping 
imposed by the cycle of operation of a heat engine is a product of the individual evolution 



steps along the branches composing the cycle of operation (Cf. IIV CI ) . Each one of these 
evolution steps is a completely positive map, so that the total evolution U cyc that represents 
one cycle of operation, is also a completely positive map. If then a state p ic is found that 
is a single invariant of U cyc i.e. U cyc p lc = p lc then any initial state p init will monotonically 
approach to the limit cycle. Based on Eq. a monotonic decreasing series bound from 
below converges to a limit. 

S(Pimt\Plc) > S(UcycPinit\Plc) > SiKycPinit I Plc) > , ( 10 ) 

where U™ yc represents a sequential mapping of the cycle n times. 

The largest eigenvalue of U cyc with a value of one is associated with the invariant limit 
cycle state U cyc p lc = lp /c , the fixed point of U cyc . The other eigenvalues determine the rate 
of approach to the limit cycle (Cf. Sec. IV A)l 

The conditional entropy has been criticized as a measure of distance since it is not sym- 
metric in p and p re j and therefore does not form a metric. For this reason other measures 
have been defined. 



C. Thermodynamic Quantum Distance 

The concept of statistical distance between different pure quantum systems was intro- 



duced by W. K. Wootters jjjj, who followed R. A. Fisher's idea to measure distance in 
probability space. In the concept of distinguishability for neighboring mixed quantum 
states is described. Hiibner [itJ computed explicitly the distance between two-dimensional 
density operators, and gave a general formula for the ./V dimensional distance. A detailed 
and clear review on the subject has been presented by Diosi and Salamon 



1. Wootters Distance 



Statistical distance is associated with the size of the statistical fluctuations occurring in a 
measurements that distinguishes one state from another. Two outcomes are distinguishable 
in a given number of trials, provided that the difference in actual probabilities is larger than 
the size of typical fluctuation. The maximal number of distinguishable states that can be 
found between two probability distributions has been suggested by Wootters [3| to define 
the distance between these two states. 
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Consider two probability distributions p and q obtained from the same complete mea- 
surement of two quantum states p and p re j (Cf. Eq. ©). In order to define a distance 
between between p and q a continuous curve is sought connecting the two distributions. 
Taking advantage of normalization and that probabilities are positive, a change of variable 
is used: Xj = ^Jp. and yj = y/q.. The new variables allow a geometric interpretation, they 
define points on an N dimensional unit sphere, since x| = J2f Vj = 1- The statistical 
distance between p and q then becomes the shortest distance on the surface of this unit 
sphere between the points defined by the vectors x and y. This shortest distance is equal 
to the angle between the unit vectors x and y, given by: 

^aCpjq) = arccos (^2 x jy^j = arccos v^v^j ■ ( n ) 

For quantum systems Eq. (|TT|) corresponds to the statistical distance associated with a 
measurement of an operator A. For two commuting states the statistical distance becomes 
the arccos of scalar product of the square roots of the density operators. 

V(p,p ref ) = arccos (trjp 1 / 2 ^}) . (12) 

For two non-commuting states, the distance V(p, p re /) has to be redefined as : 



V(p,p ref ) =^ m /(tr{(W 1 -W 2 )(W 1 -W 2 )*} , (13) 

where the infimum is taken over all Hilbert-Schmidt operators describing all the possible 
operators which fulfill 

W{W* 1 = p, W 2 w; = p re/ , (14) 

and WjWo > 0. This definition of distance is symmetric in p, p re j and therefore can form 
a metric ll^J : 



V{P,Pref) = Jn^I ~ tT^{p)href{p)^j , (15) 

where N is the size of the Hilbert space. 



D. Entropy production 



Once the limit cycle is reached any observable is cyclic including the entropy. This is the 
result of the fact that the state of the system is completely determined by a finite number of 
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expectation values which are cyclic. This means that entropy change in the complete cycle 
is zero or the total internal entropy production of the working medium is zero. 

The external entropy production is positive for the limit cycle. It is a measure of the 
irreversible dissipation to the hot and cold baths: 

AS % = -(f + ff) ' (16) 
where Qh/ C is the heat dissipated to the hot/cold bath and T h / C is the bath temperature. 

III. THE QUANTUM MODEL 

The present study is based on a four stroke quantum heat engine model corresponding 
to the Otto cycle. The cycle is composed of two isochores where the working medium is in 
contact with the hot/cold baths and the external field is constant and two adiabats where 
the external field is varying. The motion is generated by the Liouville operator £ which can 
be decomposed to a Hamiltonian part and a dissipative part: 

C = C H + C D , (17) 

where C* H A = i[H, A]. The main feature of the Hamiltonian is that the external control 
part does not commute with the inertial internal part. 

H = Hi n t + Heart (£) > (18) 

and [H int , H ext ] ^ 0. 

The specific choice of working medium is composed of an ensemble of noninteracting 
coupled two-spin systems identical to the model studied in Ref. jsj]. 

A. The Hamiltonian 

The single particle Hamiltonian is chosen to be proportional to the polarization of a two- 
level-system (TLS): a 3 z . The operators & z ,& x ,& y are the Pauli matrices. For this system, 
the external Hamiltonian will be: 

fl ext = 2-V 2 u(t) (&l ® i 2 + I 1 ® <xf) = w^Bi , (19) 
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and the external control field u(t) is chosen to be in the z direction. The uncontrolled 
interaction Hamiltonian is chosen to be restricted to the coupling of pairs of spin atoms. 
Therefore the working fluid consists of noninteracting pairs of TLS's. For simplicity, a single 
pair can be considered. The thermodynamics of M pairs then follows by introducing a trivial 
scale factor. Accordingly let the uncontrolled part be: 

U int = 2-*l 2 j(al®drl-&l®& 2 y .) EE JB 2 . (20) 

J scales the strength of the interaction. When J — > 0, the model represents a working 
medium with noninteracting atoms [5(. 

The commutation relation: [B 1; B 2 ] = v / 2^B 3 leads to the definition of B 3 . The analysis 
shows jsj], that the set of operators Bi, B 2 , B 3 and i forms a closed sub- algebra of the total 
Lie algebra of the combined system. The Hamiltonian expressed in terms of the operators 
Bi, B 2 , B 3 in the polarization representation becomes: 

H = c^Bi + JBa . (21) 

The eigenvalues of H are , ± -j= where f2 = \JijS 1 + J 2 . The closed Lie algebra of the set 
{Bfc} means that it is also closed for the propagation generated by the Hamiltonian (|21|) . 



IV. THE CYCLE OF OPERATION, THE QUANTUM OTTO CYCLE 

The operation of the heat engine is determined by the properties of the working medium 
and the coupling to the hot and cold baths. The cycle of operation is defined by the 
external controls which include the variation in time of the field with the periodic property 
uj{t) = oo(t + t) where r is the total cycle time synchronized with the contact times on 
the different branches of the cycle. The cycle studied is composed of two branches where 
the working medium is in contact with the hot/cold baths and the field is constant, termed 
isochores. In addition, there are two branches where the field u(t) varies and the working 
medium is disconnected from the baths termed adiabats. This cycle is a quantum analogue 
of the Otto cycle. The four strokes of the cycle with the corresponding parameters are (Cf. 
Fig. EJ): 

1. Isochore A —>■ B: the field is maintained constant & — Uj, while the working medium 
is in contact with the hot bath of temperature with heat conductance T^, and 
dephasing parameter 7^ for a period of r h . 

9 




FIG. 1: The cycle of the heat engine in the (u,Se) plane. The upper red line indicates the 
energy entropy of the working medium in equilibrium with the hot bath at temperature T^ for 
different values of the field. The blue line below indicates the energy entropy in equilibrium 
with the cold bath at temperature T c . The cycle in green has an infinite time allocation on all 
branches. It reaches the equilibrium point with the hot bath (point E) and equilibrium point 
with the cold bath (point F). The inner cycle ABCD is a typical cycle with the time allocations: 
Th = 2.5 Tb a = 0.01, t c = 3. T a f, = 0.01. The external parameters are: u> a = 5.08364, u>b = 
12.6355, J = 2., T h = 7.5, T c = 1.5, T h = T c = 0.3423, j h = 7c = 

2. Adiabat B — > C: The field changes linearly from ujb to uo a in a time period of Tb a - 

3. Isochore C — > D: the field is maintained constant to = u a the working medium is in 
contact with the cold bath of temperature T c with heat conductance T c , and dephasing 
parameter 7 C for a period of r c . 

4. Adiabat D — > A: The field changes linearly from uj a to Ub in a time period of r a b. 

Fig. ^displays a typical trajectory of the cycle in the plane defined by the external field 
and the entropy (u,Se)- 

The state p (Cf. Eq. (j^J)) of the working medium is completely reconstructed by the set 
{Bfc} , k = 1, 5 of five operators 0. The set of the three operators Bi, B 2 , B 3 is sufficient 
to describe the energy changes during the cycle of operation. The map U relates the initial 
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values of these operators to their final values for each of the engine branches. Implicitly this 
map is obtainable by solving a set of coupled inhomogeneous equations of motion for each 
branch jg]. An explicit description of the map is obtained by adding the identity operator 
I which transforms the inhomogeneous equations to a closed set of linear coupled 4x4 
equations. The equation of motion of the two additional operators B4 and B5 form a linear 
first order inhomogeneous equation depending on the time dependence of the closed set 
Bi, B 2 , B 3 and I. As a result they form an additional 2x2 block in the map. 



A. Propagators on the isochores 



The dynamical map U{r c /h) on the isochores is generated by both the Hamiltonian and 
the dissipative Lindblad generators representing the interaction with the bath. The 4x4 
block of the map is first solved for the set Bi, 62,63 and Since u is constant on the 
isochores a closed form of the propagator U{r c / h ) is obtained 



U{t c / h ) 



n 2 

-K— 



n 2 

X.P+cw 2 



n -2 



K- 



-K% bl q (l 
Kc 



-Tt, 



c/h 



\ 



(22) 



/ 



where K = exp{ — (r + 27fi 2 )r c // l }, X = exp(27f2 2 T c // l ), c = cos(v / 2^t c // 1 ) and s = 
sm(V2Qr c/h ), b\ q = -^(k T ~k 1), b\ q = -^{k T —k |). Finally 7 is the de- 
phasing constant, r c / h is the time spent on the cold/hot isochore , and r = k f +k J, is the 
heat-conductance to the bath. The corresponding bath temperature T c /^, enters through 
the detailed balance relation: ^j- = e T ^ . The block containing B 4 and B 5 can now be 
solved as a 2 x 2 set of coupled inhomogeneous equation of motion 



B. Propagators on the adiabats 

The propagator on the adiabats is more involved. This is due to the explicit time depen- 
dence of the Hamiltonian. Using the Lie algebra of the set of {B^} operators it is always 
possible jl^f to describe the propagator as: 

A(t) = UAU f , (23) 
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where U = exp(za 1 (t)B 1 ) exp(za2(t)B 2 ) exp(za 3 (t)B 3 ) and the coefficients a^t) include the 
effect of time ordering. The procedure is described in Appendix [X] This approach leads to 
the explicit result for the propagator of the set Bi, B 2 , B 3 , 1: 

/ c 2 c 3 -S3C1 + C3S2S1 C3S2C1 + S3S1 \ 
C2S3 C3C1 + S3S2S1 S3S2C1 - C3S1 

— s 2 C 2 Si C 2 Ci 

\ 1/ 



U a {t) 



(24) 



where: Si = sin(ai), s 2 = sin(a2), s 3 = sin^), C\ = cos(ai), c 2 = cos(a 2 ), c 3 = cos(a 3 ). 
The coefficients a can be integrated either numerically Cf. Eq. ()A5|1 or closed form solutions 
are obtained for specific functional forms of u(t) jq|. The operators B4 and B5 commute 
with the Hamiltonian, and therefore are constant on the adiabats . 



C. The global propagator 

The propagator of the cycle represents the completely positive map of the initial expec- 
tation values to the final ones after the operation of one cycle. The propagator is then 
constructed as a sequential product of the individual propagators on the different branches: 



eye 



U a b Uisc Mba Uish 



(25) 



An analytic form has been obtained for the propagators on the isochores (Eq. ()22|) ). For 
the adiabats the form of Eq. pij) has been used which is parametrically dependent on the 
a parameters. 

Table I summarizes all the control parameters defining the cycle. 

The global map enable to solve for the operator expectation values from their initial 
values. These expectation values serve to reconstruct the density operator (Cf. Eq. (jSJ) ) 



/ 1 + h. 





br, 
2 



1 _i_ ]h_ 
4 ~T V2 



65 
2 



V2 



2 



b2 „-^3_ \ 





h 1 65 / 
V2 + 2 / 



(26) 
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TABLE I: Summary of notations 



T c temperature of the cold bath. 

Th temperature of the hot bath. 

uj a value of the external field at the cold isochore. 

uJb value of the external field at the hot isochore. 

J internal coupling constant. 

T c heat transfer coupling constant to the cold bath. 

Th heat transfer coupling constant to the cold bath. 

7 C dephasing constant on the cold bath. 

7 C dephasing constant on the hot bath. 

t c time allocation on the cold isochore. 

Th time allocation on the hot isochore. 

T a b time allocation on the cold-to-hot adiabat. 

Tb a time allocation on the hot-to-cold adiabat. 

where the index p stands for the direct product spin representation. Diagonalizing the 
density operator p p Cf. Appendix B, leads to the eigenvalues of p which define the von 
Neumann probabilities: 

A2 " * + V=2~T (27) 

A3 ~ 4 ~ 72 ~ ~2 
A 4 - 4 + 73 + T 

where D = yjb\ + h\ + 6|. Functionals of the density operator such as entropy are calcu- 
lated by the spectral theorem Cf. appendix A. 

V. LIMIT CYCLES 

The heat engine's limit cycle is completely determined by the external control parameters. 
This means that irrespective of the initial state of the working medium, after running the 
engine through many cycles of the control sequence, a limit cycle is approached. This can 
be observed in Fig. |21 which demonstrates that starting from two initial conditions, the 



13 




FIG. 2: The limit cycle in the field entropy variables (u>,Se)- Two initial states represented by 
points are indicated by 1 with the field value of ujf,. The sequence of branches starting from a 
cold initial temperature are shown with circles around the numbers. The working medium of the 
engine is put in contact with the hot bath for a time duration of Th and heats up. For time r& a 
the frequency changes from u>b to co a (branch 2). Cooling due to contact with the cold bath is 
found on branch 3. For clarity the arrows do not reach the values of u; a and w&. The sequence of 
branches starting from a hot initial temperature are shown with diamonds around the numbers. 
The working medium of the engine is put in contact with the hot bath for a time duration of 
and cools down to branch 2. The contact with the cold branch further cools the engine (branch 3) 
After going through approximately 3 cycles of the engine, the two paths appear to converge to the 
same limit cycle, indicated by the ABCD rectangle. 

engine settles to the same limit cycle which is the fixed point at the bottom of the basin of 
attraction. 
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A. Approach to the limit cycle 



The timescale of the approach of the engine to the limit cycle is related to the number 
of accumulated cycles n, that are required for the variables of the engine to approach their 
asymptotic values. The different measures employed for this task are defined in Sec. ITT1 
The energy distance V E (p n , p lc ) Eq. (fTTj) and quantum distance V(p n , p lc ) were used as 
measures and are shown in Fig. El The reference state p lc can be chosen on any point on 
the engine's trajectory, on points A B C D for example or between them. The same 
point on the trajectory is used to define the state in the n'th iteration p n . It was found that 
the distances are invariant to the choice of the chosen point on the cycle's trajectory. 

Explicitly the quantum distance , T>(p n , p lc ), Eq. (fT5]) for the current working medium 
becomes: 

V(p n , Pic) = ^2 (l - (v^ + VHn)Xs(lc) + y/X 3 (n)\ 3 (lc) + v^)) , (28) 

where the normalization is chosen to be N = 2 and the eigenvalues A are the eigenvalues of 
the density operator defined in Eq. (J2*7)l and, 

^- Q± {Wr^Wh^ Y ■ (29) 

where 2q is the scalar product between the {B} components: 

3 

2q = (X ■ &L) = h M)Hlc) , (30) 

3=1 

and x = y/XxXl, 2r = | + 6 5 , y = 2(r — x)/D, Y = r\ c + qy n and finally Q is the gener- 
alized scalar product: Q = r n ■ ri c + q, (D is defined by following Eq. (|27j) ). Additional 
computational details are given in Appendix IB 21 

The distance to the limit cycle can also be associated with the conditional entropy: 

S(p n \Plc) = S(Pn)- 

(K - ^} log(X 1 (lc)) + X 2 (n) log(A 2 (/c)) + A 3 (n) log(A 3 (/c)) + {r n + ^} log(A a (/c))) , 

(31) 

which becomes zero when p n approaches the limit cycle. 

In all cases studied the quantum distance T>(p n , p lc ) monotonically approaches zero with 
the increase in the number n of accumulated cycles, Cf. Fig. El This was found also to be 
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FIG. 3: The distance T>(p n , p lc ) and the energy distance T>E(p n , Pi c ) from the limit cycle as a func- 
tion of accumulated cycles n. Four example are shown numbered from 1 to 4. The corresponding 
inserts show the limit cycle in the energy entropy Se and uj plane. The dashed lines indicated by 
E correspond to the energy distance P^(p n , p lc ). Cycles 1 and 3 are without dephasing. Cycle 2 
and 4 include dephasing on the isochores with 7^ = 0.01 and 7 C = 0.03. All cycles spend the same 
time on the isochores (77, = r c = 0.6). The time on the adiabats varies form very short, cycles 1 
and 2, to very long, cycles 3 and 4. 

true for the conditional entropy as predicted by Eq. ([TUjl. The energy distance V E (p n , p lc ) 
as in case 1# in Fig. El shows a non-monotonic periodic oscillations in the approach to the 
limit cycle. With sufficient dephasing the density operator is almost diagonal in the energy 
representation therefore the two distances converge; V(p n , p lc ) = T>E(p n1 Pi c ) Cf. cases 2 
and 4 in Fig. El 

Examining the measures of approach to the limit cycle Eq. (|2*H)l and pip, it is found 
that they have similar functional dependence on the expectation values of the set of {B} 
operators. In particular the two functionals contain the scalar product q. This indicates 
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that all quantum convex functional of p will relax to the limit cycle in the same rate. 

The dynamics of the set of operators {B} is determined by the eigenvalues of the Global 
Operator , U cyc , Eq. (J25|) . The eigenvector with the eigenvalue of fio = 1 represents the 
expectation values of the limit cycle. The decay rate to the limit cycle depends on the 
eigenvalues which are smaller than one. The eigenvalue \i\ < 1 was found to be real and 
as expected its eigenvector does not include a component of the identity operator. Fig. |U 
shows the dependence of the eigenvalues \i of the Global Operator on the time spent on the 
isochores and the coupling constants. The relationship is well fitted by [i\ = e~~( ThTh+rcTc \ 
This means that a very weak dependence on the dephasing rate was found. fi± can 
then be interpreted as the relaxation rate per cycle in the direction defined by the limit 
cycle vector. The eigenvalues /i 2 /3 = l/^le^ are complex. Their amplitude can be fitted 
t° |a*2/3 I = e~^ Vh+lh ^' h ' >Th+ ^ Tc+ ' lcnc " >Tc \ This suggests that /Z2/3 represents the rate of decay 
in a direction perpendicular to the direction of limit cycle vector. The phase of /X2/3 is 
an accumulated phase and was found to be linearly related to the time allocated on the 
adiabats. The last two eigenvalues associated with the block of B4 and B5 become /Z4 = \L\ 
and ^ 5 = (/ii) 2 ( Eq. (57) and (59) of Q ). 

The analysis reveals that the rate of approach to the limit cycle is determined by the 
accumulated dissipation on the the hot and cold isochores. The eigenvalue fix plays the role 
of the longitudinal relaxation analogue to 1/Ti, while the eigenvalues /i 2 /3 play the role of 
the transverse relaxation or I/T2. 

B. Properties of the limit cycle 

The fact that the limit cycle is closed imposes a strict periodic constraint on all properties 
of the working medium. The periodicity of the energy entropy and the von Neumann entropy 
are a key to the understanding of the cycle performance. 

1. Minimal cycle time 

A limit cycle can only exist if the total internal entropy changes on the four branches 
sums up to zero. What combinations of control parameters such as the time allocations 
lead to a stable limit cycle? This question can be addressed by searching for the opposite 
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FIG. 4: Logarithms of the eigenvalues of the global propagator U cyc . Upper panel /ii as a function 
of the accumulated relaxation Yyj^ + T c t c , the sum of the products of the coupling to the heat/cold 
baths, T h / C , with the time allocation on the corresponding isochore, r h / c . The eigenvalue is inde- 
pendent of the time allocation on the adiabats. Lower panel /i2/3 as a function of the accumulated 
dephasing (T^ + 2jf l Q,f l )Tf l + (T c + 2j c Q^,)t c . The points on the graphs represent different choices 
of parameters and time allocation on the branches. 
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CO 

FIG. 5: The energy entropy Se and the von Neumann entropy S as a function of the field u for a 
limit cycle with time allocations on the adiabats (t^ = T^ a = 0.03) and the cold isochore (r c = 0.6). 
No time is allocated on the hot isochore. Notice the horizontal line representing the von Neumann 
entropy. Other parameters are: J = 2, Th = 7.5, T c = 1.5, u> a = 5.0836387, u>b = 12.635485, 
T c = 1.7. The entropy production of the cycle is: AS U = 1.889 • 10~ 2 and the power output is 
negative V = -4.293 • 10~ 2 . 

conditions where a limit cycle cannot be closed. As was described in Sec. Ill Bl a limit cycle 
is obtained only when there is a single invariant of the propagator U cy i. An extreme case is 
when no time is allocated to the hot and cold isochores (r c = = 0). By construction the 
map U cy i is unitary and all eigenvalues are modulus 1. Thus any initial state will oscillate 
indefinitely without settling to a limit cycle. The next step in the investigation is to allocate 
some time to the cold isochore r c ^ adding a dissipative branch. Analyzing the eigenvalues 
of U cy i shows the expected invariant eigenvalue fio = 1. All other eigenvalues are smaller 
than one meaning that a limit cycle exists. The entropy picture is more surprising. The 
change in the von Neumann entropy AS a t,/b a on the two adiabats is zero (Cf. Fig. EJ) for 
any point on the cycle trajectory. Therefore the only way the cycle can be closed is that 
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the change of the von Neumann entropy on the dissipative cold isochore is also zero. A 
complementary picture is obtained by analyzing the energy entropy Se along the trajectory. 
If the two adiabats are not an inverse of each other, then the evolution after a sequence of 
two adiabats (point D — > AB — > C ) will lead to an increase in Se (Cf. Fig. EJ). To close 
the cycle this increase should be compensated by a decrease in the energy entropy on the 
cold isochore. How do these seemingly contradictory entropy balances coexist? The answer 
is hidden in the double role the cold bath plays in the entropy changes. If the state of the 
working medium (point C in Fig. |SJ) is hotter than the temperature of the cold bath, heat 
will transfer from the working medium to the cold bath , and thus decreasing the liquid's 
entropy. On the other hand the contact with the bath forces dephasing. This loss of phase 
increases the von Neumann entropy. Therefore, there is a point on the cold isochore where 
the decrease in the energy entropy is exactly compensated by the entropy increase due to 
dephasing. This scenario defines the stable limit cycle. This cycle cannot produce useful 
work. It represents a device which converts work from the two adiabats to heat dissipated 
in the cold bath in accordance with the second law of thermodynamics. 

Fig. IH1 shows three cycles with time allocated to all branches of the engine. The first 
cycle, " 1" is an extension of cycle of Fig. It has minimal contact with the hot bath. The 
position of the limit cycle on the (lj,Se) plot is as far as possible from the cold equilibrium 
point. This position maximizes the negative energy entropy change on the cold isochore. 
Cycle "2" corresponds to a zero work cycle. The work generated by extracting heat from 
the hot bath and ejecting at the cold bath is balanced by the work against "friction". This 
cycle defines the minimum operational cycle time. Cycle "3" is a typical cycle with positive 
work output. 

A search was carried out for time allocations where the cycle does not close, therefore no 
limit cycle exist. In general it was very difficult to find such conditions. These atypical cases 
with extremely small time allocations, were characterized by a non uniqueness of the limit 
cycle. For slightly longer time allocations a unique limit cycle was found which does not 
represent an engine. The reason is that the cooling on the cold isochore was not sufficient 
to dissipate the energy increase on the adiabats. As a result additional cooling was required 
on the hot isochore. The onset where heat is transfered by the engine from the hot to the 
cold bath was termed in the analogous engine based on a phenomenological description of 
friction 6], as the minimal cycle time (Cf. Cycle "1" in fig. EJ. Additional time allocation 
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FIG. 6: Three cycles corresponding to the minimal cycle time "1", zero power output "2" and 
positive power output "3". The time allocations on the isochores are: on cycle "1" = 0.32, r c = 
0.64, on cycle "2": T h = 0.581, r c = 1.1602, and on cycle "3": T h = 1.5, r c = 3.6. The common 
parameter values on all three cycles are: r a b = 0.05, T ba = 0.06, J = 2, Th = 1.0048, T c = 
0.10662, u b = 12.63545, uj a = 5.0836387, T h = 7.5, T c = 1.5. 

is required to reach the onset of positive work output (Cf. Cycle "2" in fig. 
2. Entropy Production 

The position of the limit cycle is determined by the balance of entropy. Since on the 
adiabatic branches the von Neumann entropy is constant the increase in the entropy of the 
working medium on the hot isochore should be exactly compensated on the cold isochore. 

Examining the entropy changes on the hot isochore, one can compare the external entropy 
production ASff* = —Qh/Th to the internal change. Schlogl suggested [3, [sij] , that the 
internal entropy production is related to the difference in the conditional entropy associated 
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with the equilibrium state: 

AS* = S E (p A \p eq (T h ))-S E (p B \p eq (T h )) , (32) 

where p A is the state at point A on the beginning of the hot isochore, p B is the state at 
point B at the end of the hot isochore and p (T/J is the equilibrium state at point E. Using 
the fact that the equilibrium density operator is diagonal in the energy representation i.e. 
$e {p A \p eq (T h )) = S E {p A ) - E A /T h + logZ, Eq. © takes the form: 

AS E = S E (p A )-S E (p B )-^ (33) 

J-h 

since Q h = (E b - E a ). 

The full quantum characteristics representing the deviation of the density operator from 
the energy representation are obtained by the conditional entropy: 

AS u h = S {p A \p eq (T h )) - S (p B \p eq (T h )) = S{p A )-S{p B )-^ . (34) 

h 

For very long cycle times and sufficient time allocation on the isochores the system is 
diagonal in the energy representation. As a result Eq. and Eq. (|3*2*|) are equivalent. The 
difference between the internal entropy production A5*^ and the external AS^ xt = —Qh/Th 
represents the entropy increase in the working medium. The same measures can be applied 
to the cold isochore. Summing the entropy changes on the two branches leads to equality 
between the changes in external and internal entropy production: 

AS u h + AS: = - (jr + jr) , (35) 

since the von Neumann entropy S is constant on the adiabats. The energy entropy is not 
constant on the adiabats leading to a different relation for the energy entropy production: 

ASf + AS* = + AS* + AS* , (36) 

where AS* b is the change in energy entropy on the adiabat which can be interpreted as the 
entropy generation on the adiabats. 

VI. CONCLUSIONS 

Summarizing the study is best carried out by addressing the questions raised in the 
introduction. 
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A. How do the control parameters characterize the approach to the limit cycle? 

The existence of a limit cycle is subject to there being a unique invariant of the global 
propagator. The invariant has an eigenvalue [io = 1 and its eigenvector is expressed via the 
expectation values of Bi, B2 B3 and I in the limit cycle. 

Quantum measures were developed to characterize the approach to the limit cycle: the 
conditional entropy and the quantum distance. These measures show a monotonic approach 
to the limit cycle. The projected measures such as the energy distance or energy conditional 
entropy can show an oscillatory approach to the limit cycle. Close to the limit cycle the rate 
of approach of all measures converge to the same value. The quantum distance was always 
larger than the probability distance associated with the measurement of energy. Dephasing 
eroded the deviation between the two distances. 

Longitudinal and a transverse modes of approach to the limit cycle could be identified. 
The rate of approach is associated to the eigenvalues of the propagator. The eigenvalue /ii 
determines the longitudinal relaxation rate, /xi exponentially depends on the accumulated 
energy relaxation on the hot and cold isochores ji\ oc e~( VhTh+VcTc \ The transverse rate of 
approach is associated with the eigenvalues 7/2/3 • Their magnitude depends on the accumu- 
lated dephasing on the hot and cold isochores | yu.2/3 1 e~^ Th+lhQ ' h)Th+ ' yVc+lcQ ' cS)Tc \ The phase 
4> of /i 2 /3 is linear in the time allocation r ab + r ba . The dependence of the rate of relaxation 
on other parameters such as J was found to be weak. 

B. Can conditions be found for non-existence of the limit cycle? 

When no time is allocated to the hot and cold isochores r h = r c = then the evolution 
is unitary and the modulus of all eigenvalues of the propagator become 1. As a result 
no unique limit cycle can be found. For very short times allocated to the isochores, two 
eigenvalues of the cycle propagator became equal to one, again no limit cycle is obtained in 
these conditions. Therefore there exist a 5t <C 1 range of time allocation on the isochores 
for which no unique limit cycle can be closed. 
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C. What are the irreversible properties of the limit cycle? 



Heat transport between the working medium and the baths is a common source of irre- 
versibility for all realistic heat engines. If this is the only source of entropy generation the 



engine is classified as endoreversible [22j,|22|, meaning that entropy is only generated on the 
interface and that the internal operation is reversible. The dissipative forces accompanying 
heat transfer were found to be sufficient to drive a quantum two-level endoreversible heat 
engine to a limit cycle Q]. 

Friction is an additional source of irreversibility for all realistic heat engines, characterized 
by an internal entropy production. The heat generated by friction eventually has to be 
disposed in the cold bath. The performance of the present first principle quantum engine 
has been shown to be limited by a friction like phenomena p. The key to the understanding 
of the quantum origin of friction lies in the difference between the energy entropy Se and 
the von Neumann entropy S. Since the von Neumann entropy is constant on the adiabats 
one could classify the model as endoreversible (Cf. Eq. (|35)l). Following the engines cycle 
by observing its energy changes shows characteristics of entropy generation on the adiabats 
(Cf. Eq. (jSED). 

The most illuminating case which characterizes the irreversible character due to the 
nonadiabatic dynamics is a cycle composed of two adiabats and only a cold isochore as 
displayed in Fig. External work is converted to internal heat which is dissipated to 
the cold bath. The only phenomena that fits this behavior is friction. Surprisingly, the 
von Neumann entropy for the complete cycle trajectory is constant. This is in contrast 
to a power producing cycle where the von Neumann entropy changes on the isochores. A 
detailed analysis of the von Neumann entropy change on the cold isochore performed in the 
energy representation unravel the picture. A decrease in the entropy of diagonal elements, 
equivalent to ASe due to cooling of the working medium is exactly compensated by an 
entropy increase due to dephasing i.e. loss of the nondiagonal elements. It seems therefore 
that friction is the result of the interplay between the unitary evolution on the adiabats 
and the dissipative dynamics on the cold isochore. Friction is found only when the state 
of the quantum engine deviates from a diagonal energy representation. Such dynamics are 
a consequence of the nonadiabatic operation conditions caused by the noncommutability 
of the working medium Hamiltonian at different points along the cycle trajectory. These 
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observations are the basis for a quantum control of friction which will be presented in a 
future study. 
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APPENDIX A: ANALYTICAL SOLUTION OF THE PROPAGATOR ON THE 
AD I AB ATS 

The analytic solution for the propagator on the adiabats is based on the Lie group struc- 
ture of the {B} operators. The unitary evolution operator U(t) for an explicitly time 
dependent Hamiltonians is obtained from the Schrodinger equation: 

-if t tJ(t) = H(i)U(i), U(0)=i . (Al) 

The propagated set of operators becomes: 

§(t) = U(t)!(0)Ut(t) = W o (*)J(0) , (A2) 

and is related to the super-evolution operator U a {t). Based on the group structure Wei and 
Norman, constructed a solution to Eq. (|A1|) for any operator H which can be written 
as a linear combination of the operators in the closed Lie algebra H(£) = YlJLi hj(t)Bi, 
where the hi(t) are scalar functions of t. In such a case the unitary evolution operator U(i) 
can be represented in the product form: 

m 

U(t) = l[exp(a k (t)B k ) . (A3) 

k=l 

The product form Eq. (|A3|) substitutes the time dependent operator equation (jAl|) with 
a set of scalar differential equations for the functions ctfc(t). Writing the unitary evolution 
operator explicitly leads to: 

U(t) = exp(t— — Bi)exp(i— ^=-B 2 ) exp(z— ^B 3 ) (A4) 
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The a/2 factor is introduced for technical reasons. Based on the group structure [l2>] Eq. 
ilj) leads to the following set of differential equations for the coefficients a: 

sinfai) 



a 



i-i 



sin (a i J sm.\a,2j 
cosfa^) 



a 2 = V / 2Jcos(«i) ; a 3 



coslcM 



• (A5) 



APPENDIX B: THE DENSITY OPERATORS 

1. Functions of the Density Operators 

i 

a. Computation of pp and log p p 
First p p , Eq. 



is diagonalized by the unitary matrices Q p , Q p : 
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where -D = \/&i + 62 + ^i; and A« are the eigenvalues of p which are the von Neumann 
probabilities, Cf. Eq. ((23). 

1 i 1 1 1 

The eigenvalues of become , A| , A| , A| . From Eq. IB2I one 

1 1 

has: p p = Qlp vn Q p , therefore pp 2 = Q\plnQ v , and log/3 p = Q\\ogp vn Q p . Ex- 
plicitly: 
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and 
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b. Computation of pe and log p e 



To get p in the energy picture p p is transformed by the matrix C which diagonalized the 
iamiltonian, see [8|. Denoting f2 = y/uj 2 + J 2 , /i = and x = \/%q^, C becomes 
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where = ujb\ + J&2- In equilibrium, the off-diagonal elements vanish. 

p p = Cp e C , therefore : p vn = Q p p p Q\ = Q p Cp e CQ} p . It follows, that the diagonalizing 

i i 

matrices of p e , become: Q e = Q P C, and Q\ = CQ P . As a result pt = Q\pvnQ e 
and log(p e ) = Ql hg(p vn )Q e . Explicitly: 
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Any function of the density matrix can be computed by the diagonalizing vectors of the 
density matrix. 

2. Additional details of quantum distance 



In subsection IV A| a closed form expression was obtained for the quantum distance, Eq. 
(|28)1. For the computation the polarization frame, p p , was used. 



The operator M = (p) ^ p re Ap) 2 required in Eq. (fTKJ) is first computed. 
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where the notations of Eqs. (j2Hj) was used, (jSHJ) and (jHOJ), and where 
A 2 = Af (n)Af (Zc), and A 3 = Af (n)Af(Zc). 

Calculation of T>(p nl p lc ), requires the value of tr{y^L}. The matrix representation of 
M breaks up into two internal and external 2x2 sub-matrices. Denoting the eigenvalues of 
the external Mi,4 submatrix by Q, one has: 
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